Algorithms for singularly perturbed limiting average Markov control problems
نویسندگان
چکیده
منابع مشابه
Singularly perturbed filters for dynamic average consensus
This paper proposes two continuous-time dynamic average consensus filters for networks described by balanced and weakly-connected directed topologies. Our distributed filters, termed 1st-Order-Input (FOI-DCF ) and 2nd-OrderInput Dynamic (SOI-DCF ) Consensus Filters, respectively, allow agents to track the average of their dynamic inputs within an O(ǫ)-neighborhood. The convergence results and s...
متن کاملFem for Singularly Perturbed Problems
We consider the numerical approximation of singularly perturbed elliptic boundary value problems over non-smooth domains. We use a decomposition of the solution that contains a smooth part, a corner layer part and a boundary layer part. Explicit guidelines for choosing mesh-degree combinations are given that yield nite element spaces with robust approximation properties. In particular, we const...
متن کاملControl of Singularly Perturbed Markov Chains: a Numerical Study
This work is devoted to numerical studies of nearly optimal controls of systems driven by singularly perturbed Markov chains. Our approach is based on the ideas of hierarchical controls applicable to many large-scale systems. A discrete-time linear quadratic control problem is examined. Its corresponding limit system is derived. The associated asymptotic properties and near optimality are demon...
متن کاملN -widths for Singularly Perturbed Problems
Kolmogorov N-widths are an approximation theory concept that, for a given problem, yields information about the optimal rate of convergence attainable by any numerical method applied to that problem. We survey sharp bounds recently obtained for the N-widths of certain singularly perturbed convection-diffusion and reaction-diffusion boundary value problems.
متن کاملHamiltonian Cycles and Singularly Perturbed Markov Chains
We consider the Hamiltonian cycle problem embedded in a singularly perturbed Markov decision process. We also consider a functional on the space of deterministic policies of the process that consists of the (1,1)-entry of the fundamental matrices of the Markov chains induced by the same policies. We show that when the perturbation parameter, ε, is less than or equal to 1 N2 the Hamiltonian cycl...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Automatic Control
سال: 1992
ISSN: 0018-9286
DOI: 10.1109/9.159585